AWS Develops Custom Liquid Cooling System for Nvidia’s Next-Gen AI GPUs

Amazon Web Services (AWS) has engineered a bespoke liquid cooling solution to address the thermal demands of Nvidia's cutting-edge AI GPUs. The In-Row Heat Exchanger (IRHX) system targets data centers deploying high-performance chips for training large AI models, where traditional air cooling falls short.

The innovation reflects the escalating infrastructure challenges posed by AI's exponential growth. AWS prioritized in-house development after determining market solutions couldn't scale efficiently. The modular design supports both retrofits and new installations without major redesigns, circulating chilled liquid NEAR server rows to dissipate heat from densely packed processors.

Dave Brown, AWS VP of Compute Services, emphasized conventional approaches wasted floor space and water resources. While adequate for small deployments, existing systems lacked the capacity required for hyperscale operations. The MOVE signals how cloud giants are reengineering fundamental data center architectures to support the AI revolution.